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ABSTRACT:  Engineering  design  is  a  process  in  which  a  system’s  parameters  are  selected  such 
that  the  system  meets  certain  criteria.  These  criteria  vary  in  nature  and  may  involve  such  matters  as 
structural  strength,  implementation  cost,  architectural  considerations,  etc.  When  random  variables  are 
part  of  a  system  model,  an  added  criterion  is  usually  the  failure  probability.  In  this  paper,  we  examine 
the  buffered  failure  probability  as  an  attractive  alternative  to  the  failure  probability  in  design 
optimization  problems.  The  buffered  failure  probability  is  more  conservative  and  possesses  properties 
that  make  it  more  convenient  to  compute  and  optimize.  Since  a  failure  event  usually  occurs  with  small 
probability  in  structural  systems,  Monte-Carlo  sampling  methods  require  large  sample  sizes  for  high 
accuracy  estimates  of  failure  and  buffered  failure  probabilities.  We  examine  importance  sampling 
techniques  for  efficient  evaluation  of  buffered  failure  probabilities,  and  illustrate  their  use  in  structural 
design  of  two  multi-story  frames  subject  to  ground  motion.  We  formulate  a  problem  of  design 
optimization  as  a  cost  minimization  problem  subject  to  buffered  failure  probability  constraints.  The 
problem  is  solved  using  importance  sampling  and  a  nonlinear  optimization  algorithm. 


Uncertainty  in  loads,  material  properties  and 
other  parameters  need  to  be  accounted  for  in 
designing  modern  engineering  systems.  For  that 
purpose,  the  choice  of  how  reliability  is 
quantified  plays  an  important  role  when 
assessing  the  feasibility  of  a  certain  choice  of 
design  parameters.  One  such  quantification  is  the 
failure  probability,  see,  e.g.  Ditlevsen  and 
Madsen  (1996).  The  buffered  failure  probability 
is  an  alternative  presented  in  Rockafellar  and 
Royset  (2010);  see  also  Rockafellar  and  Royset 
(2015),  which  offers  computational  and  practical 
benefits  over  the  fonner  choice.  Design 
optimization  problems  with  buffered  failure 
probability  constraints  are  in  some  sense  no 
harder  to  solve  than  the  underlying  detenninistic 
design  optimization  problems.  In  particular,  if  a 
deterministic  design  optimization  problem  is 
convex,  the  corresponding  stochastic  one  with 
buffered  failure  probability  constraints  is  also 


convex.  This  situation  is  dramatically  different 
than  that  for  failure  probability  constraints, 
which  involves  significant  added  complications 
when  passing  from  the  deterministic  to  the 
stochastic  problem.  Moreover,  the  buffered 
failure  probability  captures  tail  behavior  more 
comprehensively  than  the  failure  probability  and, 
in  fact,  incorporates  the  degree  of  failure  to  some 
extent;  see  Rockafellar  and  Royset  (2010)  for  a 
discussion. 

Analytical  computation  of  the  buffered 
failure  probability  is  usually  not  possible. 
Consequently,  numerical  sampling  techniques 
are  usually  used;  namely  Monte-Carlo  Sampling 
(MCS)  methods.  However,  since  failure  events 
may  occur  with  low  probability,  MCS  methods 
require  large  sample  sizes  to  estimate  the  value 
of  both  failure  and  buffered  failure  probabilities, 
and  therefore  also  long  computing  times. 
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Importance  Sampling  (IS)  is  a  method  that 
can  improve  accuracy  and  require  fewer  sample 
points  to  estimate  (buffered)  failure  probabilities. 
This  paper  uses  buffered  failure  probability  as  a 
quantification  of  reliability,  describes  a  method 
of  evaluating  buffered  failure  probability 
constraints  by  IS,  and  incorporates  the  method 
into  the  design  of  a  structural  system.  An 
example  involving  two  multi-story  structural 
frames  subject  to  ground  motion  is  studied  in 
detail. 


1.  IMPORTANCE  SAMPLING 

In  this  section  we  explain  the  concept  of  IS. 


1.1.  Definition 

Given  a  random  variable  Y  with  probability 
density  function  /,  the  expected  value  of  Y  is 
defined  as 


E[Y]  =  Cmyf(y)dy. 


Let  y1,y2>  —  >yn  be  realizations  of  Y, 
independently  sampled  according  to  f  Then,  the 
expectation  of  the  random  variable  Y  can  be 
approximated  by 


E[Y] 


if 

nZ_i 


Vi 


i=i 


Multiplying  Eq.  (1)  by  where  h  is  a 

probability  density  that  is  zero  only  when  /  is 
zero,  we  obtain  that 


f°°  yfiy) 

m=LW)hMdy 

\  vm 

KV) 


where  now  V  is  distributed  according  to  h.  Thus 
with  v1,v2, ...  ,vn  sampled  from  h  we  find  that 


i=l 


Vjfivd 
h{vt ) 


Appropriate  choices  of  sampling  density  h  may 
result  in  an  increased  efficiency  in  estimating  the 
expectation;  see  for  example  Asmussen  and 
Glynn  (2007). 

2.  BUFFERED  FAILURE  PROBABILITY 
Failure  of  a  structural  component  is  defined  by 
means  of  a  limit-state  function  g  (x,  v),  where  x 
is  a  vector  of  design  variables,  and  v  is  a  vector 
of  quantities  that  represent  uncertain  parameters 
of  the  system  (e.g.  loads  and  material  strength), 
see  Rockafellar  and  Royset  (2010).  It  is  common 
that  the  vector  of  uncertain  parameters  is 
modeled  as  a  vector  of  random  variables 
V  =  (Vi,  V2,—,Vm)  described  by  a  given  or 
estimated  joint  probability  density  function.  We 
henceforth  denote  all  random  variables  using 
upper  case  letters  and  their  realizations  with 
lower  case  ones.  For  a  realization  v  of  V,  and  a 
choice  of  design  variables  x,  the  system  is 
assumed  to  be  in  an  unsatisfactory  state,  i.e.,  in 
failure,  when  g(x,  v)  is  strictly  positive.  The 
event  of  failure  is  thus  described  by  (,g(x,V)  > 
0}.  We  note  that  g(x,  V)  is  a  random  variable  for 
any  fixed  design  x. 

In  this  section  we  define  the  buffered  failure 
probability  and  describe  methods  for  assessing 
whether  it  is  sufficiently  small. 

2.1.  Definition 

For  a  fixed  x  and  a  given  probability  level  a,  we 
recall  that  the  a-quantile  of  g(x,  V),  denoted  by 
qa(x),  is  the  smallest  scalar  q  such  that 

P(g(x,V)  <  q)>  a 

where  P  is  the  probability  measure.  We  define 
the  a-superquantile  as 

i 

Ra(X)  =  j 

a 


It  is  clear  that  a  superquantile  is  a  nonnalized 
average  of  quantiles  for  a  range  of  probability 
levels. 
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If  the  cumulative  distribution  function  of 
9  (x>  V)  is  continuous  at  ga(x),  then  a 
superquantile  is  equivalently  expressed  by 

RaOO  =  E[g(x,V)\g(x,V)  >  qa00]. 

It  is  clear  that  in  this  case,  a  superquantile  is  the 
expected  value  of  ,g(x,V),  conditioned  on 
g  (x,  V)  being  greater  or  equal  to  the  a-quantile. 
Regardless  of  the  cumulative  distribution 
function  of  g(x,  V),  a  superquantile  can  also  be 
expressed  as  the  optimal  value  of  a  minimization 
problem  (see  Rockafellar  and  Royset,  2010),  i.e., 

?aW  = 

min{y  +  E[max{g(x,  V)  —  y,  0}]}  C' 

y 

Computing  a  superquantile  thus  involves  finding 
a  scalar  y  that  minimizes  a  convex  function  given 
in  terms  of  an  expectation,  which  is 
straightforward  when  the  distribution  of  V  is 
known  and  the  limit-state  function  can  be 
evaluated  relatively  easily. 

If  g  (x,  V)  follows  a  discrete  distribution 
with  realizations  y1  <  y2  <  ■  ■  •  <  yn  and 
corresponding  probabilities  p1(p2  >—>Vm  a 
superquantile  obeys  the  expressions 

n 

q«(x)  =  V  PjVj  if  a  —  0 

7  =  1 


The  buffered  failure  probability  p(x)  is 
defined  in  terms  of  a  superquantile.  Specifically, 

p(x)  =  1  —  a 

where  a  is  the  probability  level  such  that 
qa  (x)  =  0.  Consequently,  the  buffered  failure 
probability  constraint 

p(x)  <  1  —  a 
is  satisfied  if  and  only  if 
RaOO  ^  0. 

This  equivalence  will  be  utilized  when 
fonnulating  design  optimization  problems  below. 

2.2.  Superquantile  estimates  using  IS 
In  this  subsection  we  discuss  sampling 
techniques  for  estimating  superquantiles  for  a 
given  probability  level.  Moreover,  we  present  a 
method  to  compute  an  estimate  of  an  upper 
bound  of  a  superquantile  and  build  a  confidence 
interval  around  it.  For  probability  levels  close  to 
1,  the  event  {g(x,V)  >  y}  appearing  in  Eq.  (1) 
occurs  with  small  probabilities  for  typical  values 
of  v,  and  the  use  of  IS  may  become  beneficial. 

After  sampling  n'  realizations  v1;v2, ... ,  vn, 
from  a  suitable  density  h,  an  estimate  for  the 
superquantile  becomes 


and 


qa(x) 


RaOO  =  yn  if  a  >  1  -  Vn 


<?a(x)  *  min  y  + 

y 

TV  (2) 

1  1  y  maxjg  (x,  vf)  -  y,  0)  /(vf) 

n'  1  —  a/-i  h(Vj) 

i-1 

which  is  easily  computed  using  a  linear 
programming  algorithm  or  specialized 
procedures. 

Let  y*  denote  a  scalar  that  minimizes  the 
expression  in  Eq.  (2).  Next  we  obtain  n"  sample 
point  from  h,  namely  v1(  v2, ... ,  vn» ,  and  define 
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It 


1  max(g(x,  vt)  —  y* ,  0)  / (Vj) 
v  -\ - 

1  -  a  h(Vi) 


Since  the  expectation  of  this  expression  is  an 
upper  bound  on  qa(x),  due  to  the  fact  that 
y*  might  not  minimize  the  right-hand  side  in  Eq. 
(1),  it  can  be  seen  that 


nrr 


i= 1 


is  an  approximate  upper  bound  on  qa(x).  For 
large  n "  and  an  independent  sample 
v1(v2, vn",  it  is  clear  that  Un'  is 
approximately  normal,  making  the  computation 
of  confidence  interval  straightforward. 

With  sample  variance 

nrr 

a2  * - V  (iqn'  -  Un'Y 

n"  -  1  Aa  K  1  J 

i= 1 

we  obtain,  for  example,  an  approximate  95% 
confidence  interval  for  an  upper  bound  on  the  a- 
superquantile  as  [Um  —  1.96er,  Un'  +  1.96er], 


3.  SYSTEM  DESIGN 

In  this  section  we  present  a  mathematical 
formulation  of  a  design  problem  incorporating 
uncertainty  and  also  give  an  algorithm  for 
designing  a  system  as  well  as  assessing  the 
resulting  design. 

Given  a  system  described  by  a  limit-state 
function  g,  we  seek  a  design  x  that  minimize  a 
cost  function  C,  which  typically  depends  on  the 
design.  Moreover,  we  would  like  the  buffered 
failure  probability  of  the  design  to  be  no  larger 
than  1  —  a.  Consequently,  we  seek  to  solve  the 
optimization  problem 

min  C(x)  s.  t. 

xEX 

p(x)  <  1  —  a 


where  X  is  subset  of  the  space  of  design 
parameters  considered  admissible.  For  example, 
X  could  incorporate  bounds  on  the  design 
parameters  that  ensure  a  practical  design.  In  view 
of  the  equivalence  between  buffered  failure 
probability  constraints  and  superquantile 


constraints,  we  find  that  this  problem  is  identical 
to 

minC(x)  s.t. 

XEX 

QaOO  ^  0 

Moreover,  from  Eq.  (1),  this  simplifies  to  the 
problem 

minC(Y)  s.t. 

XEX 

1 

z0  +  - E  [ma x{g  (x,  V )  -  z0, 0}]  <  0 

1  —  a 


where  z0  is  an  auxiliary  variable  corresponding 
to  v  in  Eq.  (1).  Relying  on  IS  and  the  sample 
v1(  v2, ... ,  vn  from  h,  an  approximation  of  this 
problem  takes  the  form 


minC(x)  s.t. 

xEX 


fly,) 


z» +  maxk(*.v;)  -  zc.o}^ 


<  0 


This  problem  can  be  rewritten  as 

.t. 

ifW 


min  C(x)  s.  t. 

XEX 


Zn  + 


1  £-1  h(v,) 


J°  n(l-a)fL  h(Vj)  (3) 

g(x,Vj)  -  z0  <  zj  j  =  l,2,....,n 


zj  >  0  j  —  1,2,  ...,n  . 

Here,  z1,...,zn  are  auxiliary  optimization 
variables;  see  Rockafellar  and  Royset  (2010). 


The  design  and  assessment  process  can  be 
summarized  as  follows: 

•  Select  a  suitable  sampling  density  h. 

•  Sample  independently  from  h  and  obtain 
the  realizations  v1(  v2, ... ,  vn. 

•  Solve  Eq.  (3)  using  an  optimization 
solver  to  obtain  a  solution  x. 

•  Sample  independently  from  h  and  obtain 
realizations  v1(  v2, vn„  where  n'  does 
not  need  to  be  particularly  large. 
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•  Solve  for  y  in  Eq.  (2)  and  obtain  y*. 

•  Sample  independently  from  h  and  obtain 
v1,v2, ...  ,vn" .  Since  these  realizations 
are  only  going  to  be  used  to  obtain 
average  values,  and  not  to  be  used  in  any 
optimization  formulation,  n"  can  be 
large. 

•  Obtain  the  upper  bound  estimate  Un  and 
build  a  confidence  interval  around  it  as 
described  in  subsection  2.2. 

Figure  1:  Structures  subject  to  ground 
motion  and  consequently  the  risk  of  pounding. 


Frame  1  \ _ \  Frame  2 


4.  EXAMPLE  DESIGN  PROBLEM 
In  this  section  we  present  an  example  concerned 
with  the  design  of  two  multi-story  structures 
subject  to  random  ground  motion.  The  obtained 
design  is  assessed  using  IS. 

4.1.  Problem  Definition 

We  consider  two  multi-story,  single-bay  frames 
with  the  same  story  height,  separated  by  a 
distance  d  of  20  inches,  which  are  both  subject  to 
an  unknown  dynamic  load.  The  structures  have 
five  and  three  stories,  and  the  lateral  inertial  of 
each  story  is  0.25  kip.s  /in  for  both  frames;  see 
Figure  1.  We  assume  that  all  columns  in  a  frame 
have  the  same  stiffness,  and  that  all  beams  are 
rigid.  The  goal  is  to  design  the  frames  by 


choosing  values  for  the  column  stiffness  for  each 
frame  such  that  the  buffered  failure  probability 
of  pounding  between  the  two  frames  is  no  more 
than  0.1. 

4.1.1.  Stochastic  Load 

The  system  is  subject  to  a  ground  acceleration 
assumed  to  be  white  noise  of  duration  20s  with 
uncertain  stationary  amplitude.  The  amplitude  is 
modeled  by  a  lognormal  distribution  with  mean 
0.4  G  and  standard  deviation  0.05  G.  We  adopt  a 
time  discretization  with  timestep  of  0.02  seconds. 
The  random  vector  V  therefore  comprise  1000 
independent  lognonnal  random  variables  of  this 
kind.  The  assumed  load  is  a  simple  model  of  an 
earthquake  ground  motion  here  used  for 
illustration. 

4. 1.2.  Limit  State  Function 

We  let  x—(k1,k2)  be  the  vector  of  design 
parameters,  with  kt  representing  the  stiffness  of 
each  column  in  each  story  of  the  leftmost  (taller) 
frame  in  Figure  1  and  k2  representing  those  of 
the  right  frame. 

With  uft,  m)  being  the  displacement  of  the 
mth  story  of  Frame  i  at  time  t  (with 
displacements  to  the  right  taken  as  positive),  we 
define  the  limit-state  function 

d(x,  v)  = 

—  min  {  d  +  u2{t,rn)  —  u1(t, m)} 

t,m= 1,2,3 

We  use  central  differences  to  solve  the  dynamic 
system  with  time  step  0.02  and  ignore  the 
inaccuracies  this  introduces  in  the  evaluation  of 
displacements.  Likewise,  the  minimization  over 
time  is  taken  over  the  1000  discretized  time 
points. 

4.1.3.  Cost  Function 

Since  it  is  reasonable  to  assume  that  construction 
cost  is  proportional  to  stiffness,  we  adopt  the  cost 
function 

C(x)  —  5  kt  +  3  k2. 
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4.1.4.  Computational  Setup 
As  sampling  distribution  in  IS,  we  use  a 
lognormal  distribution  of  mean  0.488  G,  and 
standard  deviation  0.05  G.  The  design  process 
discussed  in  Section  3  is  implemented  in 
MATLAB,  using  “fmincon”  to  solve  all 
optimization  problems.  Following  the  notation 
established  in  Section  3,  we  let  n,  n' ,  and  n"  be 
40,  40,  and  500  respectively.  Computations  are 
carried  out  on  a  laptop  with  8.00  GB  RAM  and 
an  Intel®  Core™  i7-4700MQ  CPU  @2.40GHz. 

4.2.  Design  Results 

We  solve  Eq.  (3)  with  IS  and  n  =  40,  which  takes 
approximately  25  minutes  of  fmincon  solver 
time,  including  repeated  evaluations  of  the 
dynamical  system.  We  obtain  a  column  stiffness 
of  57.44  kips/in  for  Frame  1,  and  105.93  kips/in 
for  Frame  2. 

4.3.  Design  Assessment  Results 

Although  the  obtained  design  satisfies  all 
constraints  in  Eq.  (3),  the  sample  of  only  n  =  40 
results  in  an  approximation  of  the  buffered 
failure  probability.  We  next  make  an  assessment 
of  the  actual  buffered  failure  probability.  Using 
the  explicit  fonnula  for  the  case  of  discrete 
distributions  and  a  sample  size  of  around  1.5 
million,  we  obtain  a  0.9-superquantile  of  -0.71, 
which  is  essentially  exact.  This  shows  that  the 
0.9-superquantile  is  below  zero  and, 
consequently,  the  buffered  failure  probability  is 
below  the  required  0.1.  However,  such  a  large 
sample  size  is  excessively  costly  in  practice  and 
we  would  like  to  reach  the  same  conclusion 
using  a  much  smaller  sample  size.  Using  a 
sample  size  n'  =  40  and  n"  =  500,  we  obtain 
an  approximate  95%  confidence  interval  of  an 
upper  bound  of  the  0.9-superquantile  as 

[-0.078,0.039], 

Ideally,  we  would  have  liked  to  have  a  design 
with  a  confidence  interval  that  is  entirely  below 
zero.  However,  one  cannot  expect  to  achieve  this 
for  small  sample  sizes  due  to  sampling  error.  In 
fact,  if  the  sample  sizes  n'  and  n"  had  been 


increased,  then  such  a  conclusion  would  be 
obtained. 

5.  CONCLUSIONS 

We  have  presented  an  algorithm  for  the  design 
and  assessment  of  a  system  with  stochastic 
parameters.  The  approach  relies  on  the  buffered 
failure  probability  to  quantify  reliability,  which 
facilitates  solution  of  the  resulting  design 
optimization  problem  using  standard 
optimization  solvers.  Importance  sampling 
provides  hope  that  such  design  optimization  can 
be  carried  with  a  relatively  small  sample  size.  In 
the  design  of  two  structural  frames  subject  to 
ground  motion,  we  find  that  a  feasible  design  is 
obtained  with  as  little  as  40  samples.  Subsequent 
assessment  of  that  design  using  540  samples 
provides  near  certainty  that  the  design  satisfies 
the  required  reliability  level. 
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